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ABSTRACT 


MeMesee ms thesis Which discusses the solution of con- 
eave -convex Games. An aleorithm is developed, a computer 
program written and applied to an anti-submarine warfare 
Pmec wo OCI rlOn DrODlcm asean tilustration. Techniques 
for handling concave-convex problems in high dimensions 


are included. 
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se A GAME THEORY APPROACH TO RESOURCE ALLOCATIONS 

Problems in the allocation of resources can be divided 
WREOMEWONGeSGLIptive GCatecories: Sangle-agent problems and 
adversary problems. Single-agent problems have only one 
Poamelecinait Optimizing withous intelligent opposition. In 
mie SOlUTITON Of adversary problems, opponents work at cross 
mommOosesS, Each cholce of an allocation of resources by one 
participant must be made in light of those of his opponent(s). 
Of course, games are adversary problems. 

Hie woOncaeeIntehest In GCaneutneory a5 4 Ce@ineque of 
modelling which followed von Neumann's statement of the 


~”~ 


s ~! . s. x fue 
j eer E Us Voda. ihe 


©) 


Menagamencal Concsots in 2227 li 
fascination of the game as a model for conflicts of almost 
Mie sOrt 1S enhanced by the fact that the solution to a 

fame 1S entirely independent of assumptions regardine the 
mepuat benavior of the antagonist (s). 

MA So CamMeomina malt fonentldl sogmesmare cxtens 1 Vc ly 
treated in the literature; some references are noted here. 
iderix games Or games over the square are discussed in 
Basic form by Williams [21] and a thorough study is done by 
vel oi rOr a first essay im tie Subject of differen- 
tial games, see Isaacs [6]. Taylor [16,17] gives additional 
SMe suOt tie modelling @L compat Operations including 
Sc ancieUciingsditterential Games. 


Mewes vero ew oilmencmCde my ative game 1s due to 


Danskin [4]. A very large class cf concave-convex problems 





Vic (moms Meronmmwiel thie alporithm based on this game is 
Moited lee tc uwitieenceeGeriVvative: pame and the algorithm 


vO Veemeerom 1t that this paper 1S primarily concerned. 


B. CiEmCON TENT OF etine PAPER. BY ‘CHAPTER 

Chapter Il surveys some of the more important mathe- 
Matical ideas necessary to the development of the algo- 
Eeeenm for the solution of concave-convex games. 

Ciapucr slit isweoncermmecaiwiten the progranming, of an 
lel -subMarine warfare force allocation example. The ex- 
Miiere Serves CO illustrate both the use of the aloorithm 
mimmenc Ehcory on which it 1s founded. The problem is 
formulated and the basic computational steps toward the 
Solution are enumerated. If any fears stem from the 
feonmadable appearance of the matraces used in the example, 
miey nopetully will be dispelled by the description of the 
ioieror Input in the programming notes. TVTechinieal matters 
regarding programming are considered in some detail. 

Clr aioe Se i liesints eGerercoere Nels GoiteSemieerua oul Wiel Sone 
Geneéluding remarks. 

Ciavce tn) Teoma s somes CHONG @tOtT etn rthecr study. 

ie Aependi<neGonsists o1 the procrammine tlowenart. 


The Computer Program Listing is included as well. 





II1. MATHEMATICAL CONCEPTS 


A. GENERAL 

icy Lundanentale tneonem Of the theory of games an the 
mormmappropriate Mere 1s the following: 
| Sip pose Fixes) 1Sea COomeinuous function on x x /Y, 
mere X and=Y are compact and convex. Suppose that the set 
me poOints X(yvy) yielding the maximum to F for fixed y is 
moungeo Or Cach such y, and thae the set of poants (x) 
aac eoime the Manmimum to F for fixed x 1s convex for each 
such x. 


men there e€xast pure stratesy solutions xX and y~ 


satisfying 
eos oe ee un. NY Bey 
eS 
Caan ie | (Say ye oe 


Pecomplete proot of the theorem in this form can be found 
P| eAsSsuMine thac the conditrens for tne cxas tence, or 
Mmeeoelution Satisfying (1) are met, the problem can be stated 
merche form 


Max Mater (x.y) 
x y 


rmoch 1S Equivalent to 


Nabe 2) 
x 
where CHE) = Mantra) 
af 
The theorem applies to two-person zero-sum games. Thus, 


Max Min F(x,y) = Min Max F(x,y). 
x y y x 





Cnewiimemmeaieundiiticulty arises from the fact that, 
miichouch F may be smooth, ¢(x) 1S not in general differ- 
Piutaple 1M'ethe Ordimdm-sesense., Danskin, in [3], has shown 
Mitr einceh micheal Conmartlons On A vdidey, there exists a 
durpectional derivative in every direction. It is this fact 
that has provided the key to the solution of problems of 


the type described. 


B. THE ALGORITHM FOR THE SOLUTION OF CONCAVE-CONVEX GAMES 
The algorithm to solve games concave in the maximizing 
Mekecteand Gonvex 1 the Minimizing player 1s developed and 
paeesemeecd im creat detail in [4).—- he tollowing gives a 
Drief survey of those results which are most important for 
Mmicedesion Of the algorithm; to fill the apparent gaps, a 
mierough) reading of [4] remains necessary. 
Peon toe Derivative came 
Suppose x°eX. Associate with x° a non-empty set 
of admisstble dtrecttons y, T(x°). W is defined as the 
eumvex hull (e.¢., see [19]) of the set of points 
NO) = CR Gay), ts FY Gay), 
where yeY(x°). 
The derivative game then is 
HCY ,W) = yew 
Jerinedsovem! (x ) zx W. The maximizing player maximizes H 
Epapemonce Ol yel(x J the Minimizing player minimizes H by 


nN M&A 


enoice of wewW. 





THEOREM I 
A Mecessary and sufficient condition for the exis- 
Coe cmOnmmcmdiGect TON, Of aMerease fOr O(x) 1S that 
the value of the derivative game defined by H be 
positive at x°. The y° which yields the value of 
HilCh mind tive mC Mie 1S de plre Strate oy - 
ifemene Value 1S peSitive one can find and usé this direction. 
iemene Valuecels Non-positive, a direction of increase does 
Mee CX1St, t.e., the solution has been reached. 
Miso plicatvon or Che derivative game 1m prdctice 1S greatly 
Complicated by the necessity for approximations. 
Zo ine Lenma von scene Alternative 
The Lemma takes into exact account the approxima- 


— _ = r Paen pa ~ «5 4-4. a Somes 4 4" H - ; - 4 ~~ 4 aT ans n or 
fous TIVO VCO ti tle fe Lg eas, ears Ee os of lL4ue “Griwatel we 2 ait 


= 


© 


mwmotdtes) tlat a Certarm process (to be explarinedspelow) 
Were cither yield 42 sufficient increase to ¢{xX)\ ae a poine 
%- Or determine that the point x° is nearly optimal. Be- 
fore the lemma can be formulated in mathematical terms, 
ator urther ditrficulties and the tools with whien to over-— 


come them have to be outlined. 


we The bBrowl- Robinson luereatrve £rocess in tile 
Ube: leat ye Gane 2 


Hives brew iane Din sOimmeCpe ta sm rocess CiplOys seme 
Prominin e Idea: Bhet (G*be@ tie pay=oLf Gunction. At Stage 
N=0 both players choose arbitrary strategies x° and y®. At 


] 


stage N=1 the maximizer chooses x* such that G is maximized 


against y°; then the minimizer chooses y? to minimize G 


' 


=> 


’ 














<p 





Ais ta x anceesortforth, At stage N the maximizer cliooses 


x Zoe Clo miIE we S strategy were an evenly weichted 


Nel ee 
Meerctire Of Strategies y , *°* ,4y * the minimizer chooses 


ys As lt ie wile em Ss uStracepyawene an evenly werohted 
mixture of strategies x°, °-°- oe 


| For matrix games, Julia Robinson {12] proved 


that N-1 N 
lim sup \ Geena ~ = > G(x" Vy) = (, 
N-00 
n=0 n=0 


Danskin [1] has generalized the proof to hold 
for two-person, zero-sum games with continuous pay-off de- 
mod sover ) ©~ Y°eX and Y arbitrary compact Spaces, If 
amould pe noted here that the B-R process 1S veryesilow an 
mmvereCiece When ADDIMEad cirectiv fo Fsndyne OF Gap ee 
meron to the value of the @ame defimed by (1). However, it 
ZerOce appl Ved tOmunCw wesc CANINE tiiSsalOOrlei i OUteraemen 
Penanm auxiliary game’ for which an accurate solution 1s net 
meauired, 

The derivative game mentioned above cannot be 
solved directly because the set Y(x°) is not known. All one 
has 1s a single element yeY which approximately minimizes 
fee sy). Ihe place of the derivative game, therefore, is 
Maken by the “auxiliary game’’ employing a modified version 
Powenceb-h process descrraca bellow.) his process makes 11 
possible to keep track of the approximations involved and 
BicEtieconsedquences, INem auviiigany game’ 1s defined as 


fo Mlews- 


10 


ne - 





Bommanyec-0, Genote by Y Ox) Cikegse tOt > vey 
such that F(x,y) = ¢(x) + «. Let Y_(&) = (_) eC rae ae 


Ga 
Peer =). , ; 
ie hel Vo) - > (x ) 

Dione diy y= ae oe Ons di. ee 


O 
a minimum step size, is a game over I(x") zx Y (2) with y 


mie MaxImr2ine and y the minimizing player. This game has 
Gptimal mixed strategies for both players. Applying the 
Maca OF a2ppmOriImMarcmOptiMmiZzation to the convergence proof in 


[1] leads to 


PHeEORE | Tt 
N y N-t n 
Let y be chosen such that T 720 H(y,y ) 1s 
maximized to accuracy f, and yN be chosen such 
N — 
that 7 Z0 H(y" Vy) Toelunima zed TOomaecura cyan. 
Then . 
=a 

lim sup ? H(y,y') - ; H(y yy) | < 2(z+n). 

N00 n=0 n=0 


TNT SainoOseas FeO, COmmimamous If: 
Mee 0 be the maximum oscillation of VE({x,y) over a distance 
d_. Then 
O 


N N 


F(x°#d, yy) - F(x*.y") 2 y FOx®,y") - 8 


“6 
The lemma of the alternative now can be formulated. 
b. Statement of the Lemma 
Suppose O0<a<®, eet Cae 
inemeene ceneralized B-R process will, at some stage N, de- 
Mommie Cite Olewon Ele tVOurellovama Statements 1S true: 


le elite “Maximum Gver T(x") of the directional 


derivative does not exceed 8. 


dl 





N 


2. The point x = x° + d y. where 
N 
—N_1 n 
Y “Vy ae ae 
n=l 
N 


and the point y eY_(X%), where yN minimizes 
F(x’ ,y) PO Celine Gamers Ss ait ils tay, 

—N _N 0 10 
Fie A ) e Ex ry ) 
a 


> 0-58-35 : 
O O 
3. The Corollary of the Alternative 
Suppese that F(x,y) 1S concave in xX and convex in 
Tame tien the modukicd B-R process applied at x° wall, at 


PiicmoraAcCe uN CeckernIlc that Onenon the two fol Vowine state 


ments 1S true: 





i iNemmairT xX =—x° 2 y= ae where 
—N oo = ar 
N+] y ) b) 
n=0 


are approximate GPLImale Strate @1ccmLouw ene sane 
desks cll bye IE 

Tne INE SOC IIe xNex yields an increase to @(x) by at 

Hens teapc@ee lied same ec 
Bemcetails and proof See (4), poy s6 fr. 

Reference [4] continues with a detailed discussion 
mercelicate problems which Can only be listed here: MThe 
eeice Or the minimal step size do ite one > Melee ieee se 
eben Oo ae pOlltas: LroOmeampomnumx = the problém tof ob= 
struction; the choice of a, 8, €, their interaction with each 
other, and the choice of o where 6 1s the accuracy to which 


Max ©(x) 1s to approximate the value of the game defined by 


eZ. 


Coe eo iirricmaotcd chat the conditaens derived for the 
selection of these parameters are sufficient. 
4. The Algorithm 

Diemer menm as a consequence of the foregoing 
ieevematical GComsiderations 1s presented in section 10 and 
mor (4) andewall not be reproduced here in detail. A ver- 
bal description of its basic structure - depicted in Figure 
1 -, however, may be useful: 

The maximizing player, called Max, having arrived 
at a point xx, has a direction of maximal increase y, ob- 
mained Cither ~trom the derivative game D (xx) or from 


MmigewbB-R process in the attxiliary game, and a distance d => d.. 


Mee MIniInmizimnesplayer, Called Min, 1s al a point yy. F(xx;yy) 
M5 XnOwn. Max makes a proposai tu Tlove to a point x = xx + dy. 
Pemeourse, F(xX,yy) > P(xXxX,yy)-) Min a@ecepts Nax'’s proposal 


oma Starts Minimizing against x, beoking for a direction 
Semmaximal decrease ¢g. If there 1s none, yy 1S a minimum 
fooist xX aS weliNas against XxX in which case Max will move 
to the point x. If there is a direction of decrease Min 
moms a point y = yy + De such that F(x,y) < F(x,yy). <A test 
is performed to determine whether Min has already "beaten" 
Pies. 2t F(xXxX,yy) > F(x,y) Min stops the minimization pro- 
€ess, and Max discards his proposal x because moving to x 
will not increase o(x). Max halves the distance d and, with 
Micmcame. y, LOnMS a new aewialegwomme x, If F(xx,yvy) <. F(x;,y) 
han Continues tO Minimize umeil either F(xx,yy) > F(x,y) or 


itmean noe lroncer find=asdireeGionso: decrease. If now 


aim) 





Pate LoWwCNart ot Algorithm. 


TRIAL X AND Y | 
ALLOCATIONS 


IS THERE A 
DIRECTION OF 
DECREASE 







DUICE ESS 
FOR TRIAL X 
TRIAL X BECOMES 
NEW BASE POINT 
ATTEMPT MOVE 


FIND THE APPARENT 
DIRECTION OF FASTEST 












HAS F YES INCREASE FOR X 
GONE DOWN 
NO 
| is THERE IN | THE PROBLEM | 
Sa elle — Pa Ute lon ee ce ae 
[ vISTANCE | UP IH THE GO TO STOP 
SPACE 
YES 
FORM A NEW 4 NN 
TRIAL X | STOP | 
Ns 





Nt 


FAILURE 
FOR X 









15 DISTANCE 
AT A AAINTAAUA 


WOM AER DTU Simeon 
DISTANCE 
ENTER THE 
B-R PROCESS 


CREFER TO FLOW CHART 
OF B-R PROCESS) 


ES 


Il 





oe Dow licememinalearing@ tnat Mim, even artter a complete 
Mii Zeon seiem able te 'Deat' Max,>- Max moves to the 
Bewepoced Doamt x realizing a gain for $(xX). Max then looks 
fom anew Gdunuceuon Of increase. The process terminates when 
saoecn a Giyectden docs mot Exist. 

The situation that leads into the Brown-Robinson 
process 1S the following one: the proposed points x = xx+dy 
Daven becen beaten by Min wheil d gets cut down to da ei 
Meee sot the Bact that, ,,obvammed from the derivative came, 
moma apparently good direction. ~lfr the trial poant x = xx 
+ doy Coe smIOulTMeSULt I) wamiienmeesGi aiax, tie B-Kemrecess. 


Peeure 2, 15 Used. 


Denote the present y= the one that so tar has 
ie, CO SS jakiure Tor Max Seo {wom inc ws Sy Cuewcamy 
x 
by w°. Minimize F completely against x = xx + eee ie 


/mesuiting y then leads to a new ie which 1S averaged with 


SUppOse elat G) as mipUtmEo 


the previous w®, giving w 
mile GeriVvative game DO (x) produces anew y° such that the 
fade Of the derivative game 1S positive as required. “(lf 


Such a y° does not exist the problem is solved). This y, 


averaged with y’, gives y? which in turn creates a new 


miial point x*° = xx + d. ty eee OT x Sia general, then is 
eeaposed to Min'’s réaction as described previously. Once Max 
Peltowascinect lon and anvass@euatea trial point that cannot 
Berawedacen by Min MaswmovVes andeleayves the B-R routine, 


The y-strategies are also averaged and saved although their 


Micwate bs le VCT USCC —diiniiromenemmemmpic ation. .in case the 


is 





liebe 2. jute Brown-Robinson Process. 


CONDITIONS FOR ENTERING THE B-PN 


AT PT X° THERE WAS A DIRECTION ¥! OF 


APPARENT INCREASE, HOWEVER, FAILURE AT 
Wen Gece va HAVE. (Gd. 





COMPUTE: 





NBR=NBR+1 






REFORM AVERAGE, V, te 
het 
aN _ (N+) "UH Y" 





(THE SUPERSCRIPT N 
CORRESPONDS TO 
NBR ) 


FIND 
OSS Cal IAC 





S 


CALCULATE 
UG) 
YES MOVE X° 
To x" 


NO 


REFORM OMEGA BAR 


aie WN) ON 


i 


GO TO DF 
ALGORITHAA D. F. 
ae ALGORITHA 
SN yes 
: <Rax 6 o> 


rea NO 
GEV | 








pane wcctiMcamby mri x,y) 15 terminated while in the B-R pro- 
Fo con emom—niet IC Onr ENC. yY-Strategles represents the op- 


iia | SSOP tOnimnot sane Milita zineg player. 


Ay 





III. PROGRAMMING ASPECTS OF AN ILLUSTRATIVE EXAMPLE 


A. FORMULATION OF THE PROBLEM 

Taiooneiniesenetinc Solution Of 4a wide class o£ Con- 
@ave-Comvyex games over polyhedra has been presented in 
apameviated form above. In this chapter that algorithm is 
applied to a particular game, an anti-submarine warfare 
mopee allocation problem. 

Ine AETaLS Diol Ie ih, iio pall eles) eases Teno ionfercle Jal al 5 9) 
k, and m. In a meaningful example, the maximum numbers 
Sommespondine to these andices might be, respectively: 


meer LUG NS00, and 5. The indices have the following 


meanings: 
Hie Sulma eee 1 ape 
Pea bmarine mission 
jee by pe wot vane Lsubma rane weapon (Or Verne 1es) 
Ke See Lace ale Wiel eSUD iar ime and sweapen Cheoumie lh mome 
another 
m: Stage of the submarine mission. 


Pampaaditional index is used. %2&(k)}) as the “kind of place." 


faeeind ©f place” might be defined by a particular set of 


Heapon employment parameters. These include the tactical 
ama the natural environment. The natural environment con- 
Sects OL OCCanograpniilc danaymetcenelogical conditions. Ex- 


apes sOr tne tCactical EnVironment are destroyers in an ASW 
Mec cmmands patrol edalTCrabperm@imoarnier patrol. The “kind of 


Peiee S41 Wien dimeneoulucmEOcaimc ampacts on the outcome 


18 





of an encounter between submarine and weapon. A reasonable 
momen Of. kinmgsmor places ' in the present context might be 
Ss 

A submarine mission is described by a matrix MT En i jkml |: 
its Matrix mas as its elements real numbers denoting the 
exeent £O witen @ Submarine of type h at stage m of mission 
mers exposed to a weapon of type j at the kth place. The 
ewrceeSTOr timesesweapols and thus Of the Encounters are 
@tanacterized bywrea ‘technical matrix Cys ecKy | ilgls elses ak ell 
lowing meaning: EXPL Chao Ck) eae pete elits joeojla etoile ee 
PecUoMarine Of type Nh SuGVIVeS one exposure to y Units of 
merpons Of type } at a “kind of place" 2&(k). These en- 
counters are assumed to be mutually independent. Note that 


- 


PWee epi: oy Oe ea! co OMe antl! snieSeee a iae 
Bemaitioned on the completion of the previous stages. Sup- 
pose that there are Y 3k Unit Se O i) nominee Olena 1c meal nnn eu 


Merce. then the probability of a submarine’s completing 


Stage m of mission i is 


Tl exp[-E,.. TC a Ae taka 
m?<m hij km Bape ik 


ie 


Which, due to independence of the events, equals exp Phe 


where 


C 


Shim hijkm' “hje(k) %jk° 


=~ LE 
j &k 
m'<m 


Now, by carrying out a premultiplication, 
Anijkm ~ Ehijkm “njecky? 


ie 





the exponent becomes 


Ney 


Pad 


» Anijkm' 75k’ 


= ped 


"<n 


iat this example, the vast majority of the lane and there- 


fore of the A are zero. If 3000 non-zero A are 


hij km’ hijkm 
memrowod, Cach vtype Of Submarine Can be employed on ten dif- 
irent MisSions and undergo up to 60 encounters with anti- 
Submarine weapon systems. 


oy ves Syoelaer 


ere Xs Dew ines provert ion Of SUbMarines @fetype 
assigned to the ith mission. Make X = ||x,,[/| satisfy the 
conditions 
G x 
1 


and 


CU ere FORUeVe hy ep a li ie 
hi - “hi - Ba? ie ee 


where the sets fa,st, {By = 3 are supposed to satisfy 


bons < TLE 2 Bhs for every h 


an d 


QO < i < Bs HO\Tes (ONS OA joel breeloUn ale 


oe Ueno aCe ay 
bee van De Vile wp Omelet Onan tC tollomam ne sterces 
of type j sent to the kth place. Make Y = lyigl Sars fy 


Pme "Condit lons 
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ee 
aia 
=p « =a - 
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ss a 
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i V5 = IBS sPOne ise a) Y 5k > 0 


and 


as < Yak S Dig fOr sevemy= padtT 7. Kk 


where the sets taj}, {bey See espe SeGlseOmsied Si, 


d ax cds <d Dak 


and 


O) Xs ask < Der IO 1G Sse joe ea) ix - 


Alive JE ghovege Wejae des @ <6) 


V ion cicm on icmOnrteCOnpuPShIine SLagemimo. 


Joa 


feo tOl 2 fOr a submarine of type h. The character of 


F(x,y) can be examined. 


Seu 
Mh etin ~ Vee ee ore 
where ane 1s as before. Put 
1im 
Thi OL “nam 
m 
Then 


m 
F(x,y) = . Xa ie 
ieee 


irs Lunction is linear in x and exponential in y and is 
m@ererore a Concave-Convex game of the type treated in [4], 
imemreanover A « 1. Ihe qiantiey F{(x,y) sepresents the 

mMeual Cxpeeted payortrt to the Subjarine player. Re-expressing 


mix.y) in Lts explicit form gives: 


Vda 








BGS) & d d hi d Vim exp 2 L Shijkm °hj2(k)¥ jk) 


McmucmaindersOn this chapter pives details of the application 
Seeneo aileorithm fo the same defined above. 

icp meemeloal result 1s tme flow-chart (pendix )= 
peice this tlow chart 1s constructed around the algorithm 
mone 4 |. ht US ielwsul, tlouen not essential, to ave | 4] 
mubable. “lhe Complete program listing 1s included following 
the Appendix. The program is written in FORTRAN IV and was 
moon the IBM 360/67 computer at the Naval Postgraduate 


pemool, Monterey, California. 


B. BASIC COMPUTATIONS 


-~ 


“TIL sft 


1 fw Pe.) eae = oon 2 a. 7 a 
oe we NT TE ole le RO as 


Inigo nh eral! Og, Me 1S, NON -Ceecregs lilies Marine Nico 


"him 
men stage m. tIhis reflects the trivial fact that 
P{[submarine survives stage m] 


oe Pomilbiiat Wem SUMeU 1 Wes es € vealed. 


Bemality holds when the “'threat'’ due to the encounters at 
eeeee mM 1S Non-existent, 1.e€., when either no ASW-forces 


Yak Me wUkeceMe fOr ciel imckt rect Velecc AaGadinct ume SUDA name. 


Chge (ky? 1s zero. Hence 0 Ode enema ee hee! i Se a Gis 


orabiiied 


eumulated over the misSion Stages as follows: 


"him © "hi(m-) - 2 Anigkm ace Toe 0. 


tad 


F 





a 





2. Partial Derivatives with Respect to Xy4 


Be@auce wou tile linearity of F im x the partials with 


respect to xX, ., Ee wee CN weOct al elemts "OL Xia and do not 
hi 


Sep cCitly scontain x. V ePor iL =e ] can be represented as 


him him 


a matrix of dimension (n x m), where n is the number of pairs 


(h,i). Then 


Px a 2 Vnim ee ane 
lana m 
mepene sum of the ellements in the (h,i) row of that matrix. 


oc Liemvclne vor wr (x.y } 


F(x,y) is obtained by pre-multiplying Ee by Xs and 





hi 
summing the products 
P(x,y) = » *h 3 ——— 
Lda st N11 
4. Partial Derivatives with Respect to Yak 
Because of the cumulative property of Seca es axlgyelige= 


in Vik duyving some mission stage m' will affect the following 


platec> 2S Well. For cach pair (h,1), premultiply XG by 

ene corresponding A eet where m' 1s the mission stage in 

pibeehn the y., of interest occurs. Sum V... exp[-6.._] over 
ies him him 


the mission stages for which m'<m, multiply the result with 


ee. -) . and sum the products over h and i: 
meee hij km 


-F -) ¥ x. Ace y ree ec (enone | 
Yak h a hi ~hijkm' m* <i him' him 


sine DiLee tlOnsmOmmmlenmcase (Decrease) 
ee ee eee os Le Cre ase 
ie en ies are inputs to the derivative games for 
hi vk 
MeiGeny FOr x, the directionsy 92s sought such that Pe = 


eels Meximized; Mforty ye “aa sought such that DS Max F(x ,y)= 
x 


Ltd 


— 





ss 
(eee ——— = nnn 
_ 
2 a) 
—_ —- : _ 
. 





Uae 1S minimized (equivalently, ee Poona xin Zcajee — | hie 


rdw econGdmelomeis that y° and ¢- be unit vectors: 
ieee m5 c are =a Ur x ha =) Brie = al NZ een hee 
i 2 i aes 


PenethiOdsOrerlidime such directions = called THE DIRECTION 
FINDING ALGORITHM - is derived from the Kuhn-Tucker conditions 
oma@ethne Sciwartz Imequality. If 1S Contained in {4] and has 


been applied to a vector - valued function by Zmuida in [22]. 


oF PROGRAMMING NOTES 

ic hoOmmela him AMMemdiex | waldm tile associa tCdmpmoo callemay 
Mecebe Optimal with respect to machine time and memory space 
mequired, and may provide Opportunities for improvement. For 
Bomicer reutines Like this; intended to solve lnvoh-dimensional 
MaeioeciS- aA trade -Oft DeLween Lime and Space 1s ocemerally sap- 
Mmesenct, lhe user, considering the particular facilities 
myoilable to him, must decide om his optimal trade-off, and 
Meadaity the program accordingly. The following Giscusses some 
mepene Cechniques that have been implemented; at points out 
mieemajyor ditficulties that have been encountered and the ways 
Meesently used to deal with these, and offers some remarks 
m@oeeut the impact of the underlying mathematics on the use of 
Biome CoOmmiimi Lor redlisete proplems. The mumbers refereneed 
Mace Statement numbers. 

Loe ce eeeben cu tee ivewle 2S AN ea outs ogy ABS Se ye ily9) eae 

iid Peal Sti eeapolteatvon most © the Mid km will 

be zero because the effectiveness ene) contained in A will 
bemzenOny EXaniple .suppese «© denetecea place an the western 
Baltic and 2£(k) classifies this place as shallow with extreme- 


ieoeer Solar Conditions, jj denetes a nuclear killer-submarine, 


4 Neen eee nn en ee ————— 





h represents a conventional attack submarine. 


will pe Zero 
The 
Somoucine Of 


mremely easy 


Then O42 (kK) 


non soleil practical purpeses.- 


method of presenting the matrix E which avoids 


Apert en A when C 1S) zero ; 


fomeunemuser tO Understand ana employ . 


1S ONG Which 1s ex= 


ali Joa ess 


mas description Of a submarine mission by plotting it on a 


erart, MarkS Ont in Order tne places the submarine must go, 


and notes the forces it might meet at those places. 


He 


Wall give the exposure E required by the particular mission 


Mmreterms ot a Standard which he will have set. 


eo ileasma rk 


or che points gm the misSion where the various stages of 


the mission will have been accomplished. 


might run as 
Mie (0 


re ~ 
iam g 


m= 3 
The 
1) has three 


races . 


follows: 


4s 


Guiie Tiss 


ick 


rae 
ty 
fost 


SP 
I 
~] 


k=8 


jee nei 
J7=5 &=1 
= eae 
as oes 
Sac emon 
j=4 E=1. 
j=/7.. B=1. 
J=3 E=0 
J=Z, E=2 
3=4 E=0 


ES FS Da LOE 


Ca cert 


Such a description 


the f17rSt Miscmon 1s ecomplered) 


above mission (mission 1 for submarines of type 


stages and nine encounters, 


iii Olle mciied we Teme 


Then the listing starts for the next mission with 


live and conmeinueceimtnlsall=missvons for all types of 


Submarines have been described in this manner. 


Note that 


this listing has already taken into account the classification 
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Goethe p> meeeseroyee(k). This 1ssd@done in such a way that 
Lorecacheencounten on this mission listing the associated 
C52 (ik) Poo tmeivomme In Other words. a place k, and hence 

aon cOunter, Willie appear on the mission listing only if it 
ZaeomMs Decco lomunat cme Opponent will allocate forces to that 
mutee (and tne —eorrespondimng effectiveness against the maxi- 
mizer's submarine operating in that place is positive. 

There are various possible ways of storing the 
Meboriatlon Coltaimed in the mission description in the 
iaciine. “Ones way Which 1S very economical in terms of 
feoerage Space requirements 1s to read the list encounter by 


emcounter, 1.e., card by card, starting with an N=1. Then 


A(N) = E+ Ch ie (k) Sonal: Guar ilinvdhlesietos ean webs 


P(N) = I-J*KeM+(h-1) + J*KeM+(i-1) + KeM* (7-1) 


CK) ty ete LE 


Seema) the complete information. 1, J, K, M demote the 
fein Yvalues of the indices 1, }, kK, m. Ihe reason for 
using (m+l) is that the correct m appears after the mth 
merce 1S Completed. The disadvantage of this method is 
Mime during computations the individual indices must be re- 


G@omputed from P(N): 


z P(N) 
hier ar Pomiteans > Elie largest 
ieee i i) yee 
Meee (Ne 1 ee hs Git 1) 
a A | 
“— ‘| stn | 
Dorie 2 eres Vee elecale) 
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= = = : 
= 
=>> —— = -—<—- 
— 7 
- 
a 
oO 
v= _ 





> 


an A 
ee E 


AAA = AA - K-M(j-1) 


x= + [ee | 


AAA - M(k-1) 


Ss 


= 
I 


| 

ioethe Ssanple program contained in this paper, the indices 
Mimeheir Original form are stored in vector arrays and are 
directly accessible throughout the computations. 


7 ee MeOMiEnICE LOM Whihwehes Dec EO Teen 


imismecONantGelon meakes Jmmho eCCOUNL tempos Sil Diente: 
Miereche Stage m of a missa#om may have been noted, but that 
the associated eee lay sieve bcenmcdeelarcautoO Diewmze 0. 


- s e oo = 
wr = + ~ re mt nN me RF -_— on or 6¢ - 
Merere ak 62S UBC CSS eer Xe Get CE 


—_— ~ 


<6: 


) 


f 


B é q . ——= | 3 
grey 


11) 
¢ ?} 
ry) 


AVENINS invoiveny a 


( 


i 


mer corresponding elementS in the index arrays of the mission 
Macmolimnimtaeed. This 2s done prior to the execution of the 
meeceond May theretore be referred Lo as the basi1Gecontrac- 
(Gak@n. 
3. Working in Subspaces 

ifheecan DeVexpected that most of the GS and yak 
mei be On their boundaries at any stage, including the 
Meproximate optimal solution. This suggests the idea of 
eliminating computations involving variables which have 
mcd valnes Clther temporarily Oreenrolchout the process . 

Io. domes, One "reaquces “tne dimensions of the 
Setcesm CNUs Saving Machine timcwmeOne Can redefine the 
Space so as to ''freeze'' the variables on the boundaries 


fern the —Temalnaeretree tO. Meve. 


afi 





Where in the program should redefinition of the 
Y-space take place? The minimizer can hold the subspace 
maxed and continue to move in that subspace until an ap- 
parent minimum has been reached. At this point the al- 
Meeation Corresponding to this minimum has to be checked for 
Smeimality ian the tull space. This will require at least 
mee 1 terationagenmough the Minimization routine ian the ful | 
Boece. After a minimum valid in the full space has been 
Seeained, the Y-space is reduced to a new subspace. An 
mercriiative approaen is to redefine the space after each 
eranee in the Y-allocation, thus maintaining a continously 
Changing subspace. The authors feel that the latter will 
eulaoile the Minimizing variable to Stay in the subspace 


= - _ 
Fe i ce ce ee ed ~ t] - - 
Le £ . 


me a 1 fond . % 4 
-—- wa Fy Ah FN z val ae =. i = “4y4 )> er ¢3 eyeyxv os 
ae Cee ns & Gee AL DON pe il a eS! Se 9 Oo ae tw Creo Hehe Gi 


b= d 
@ 
Ke 
om. 
CL 
r> 
a i 
CQ 


eerses to employ the full space. This idea was implemented 
mimeeme program. 

SUNS Weipliesszverr sens stele Sessile hs filo) “eines sy fils) 
eliminate computations involving elements that are on the 
feomer DOUNdaries. Tt must be noted that the contraction 
Mmecelt and the complications caused by its use take machine 
mite. Worthwhile time Savings “in Computation will not be 
Per zedwimtil this technique is applied to relatively large 
scale problems. 

NOON NG eee NN emreOlealils. tie indices «o£ 
the Xe? Oe INDO) Nea ee NN ecoltaims Lic andlcesyor 
the Yak oy Jose NAS Ona enn: “aie were dimensions Of the subspaces 


for X and Y. These index arrays are used to control which 


Lie 





waolablecmare to be involved in the computations. The way 
Mims LSoedole ime practice Can be seeman the program list- 
ing. 

One remark concerning the DIRECTION FINDING ALGO- 
Meas, erJO) mand (1400), may be in order: these aleorithms 
have to be applied row by row to the matrices ||x,.|| and 
Hy 5311 In subspaces, the number of elements belonging to 
@eparticular row varies. the outer do-loop runs over the 
number of rows. To find the numbers of elements per row 
(these numbers serve as the termination values of the inner 
m@e-loops) a test on the indices stored in INDX and INDY is 
momatered (402 ff). (1402 44). “the test value. NUEST) as 


the index of the last element in the rows of | |x, and 


ll 


2 el 
‘ 


la; t | ao 8 a Tort o ioe Vee rs ald Pi a es Pe | sos mon SS 
i fib respect ivweaiv., ye Ty alllts al mane S P aa O oe ee ee 


‘ee aera eeenier ; ae So 
mete row at hand have been collected and the =aleorithim 
Fegins. Before the next row 1S picked, NSTARY 1s>incere- 
menced by the number of Clements found in the previous row 
so that the search through INDX or INDY always starts in the 
memrect position. 
4. Machine Accuracy Problems 

(TheCwDrOc baie IS eOt eer eGuciimmGces Elmo Ole Alomar & 
point numbers. Throughout the development of the program 
Emese tests have been sources of trouble. Testing for 
egulalkety Must be Strietly avotded even after - as has been 
done here in various places - variables close to a fixed 
Giditityelaye been reset to thatwquantity (e.¢., (1050 ff) 


Cee Gumi t ) Enough thespregramn Specified double-pre- 


Sool t LOOK Extensive cCxperimer tation to maintain 


Dee 


froactoOM—btys 1.e4, Satisty the sa@de conditions 


2 “hi” 2 "jk ~ ; 
to at least the 13th decimal place. 
| Cuetec MOneanee wS tne aecunacy ain tne 
es caisen Cimencn cinect lone Matin cesmya(Gn.o) eandag sCGAY) = 
In the neighborhood of a maximum or minimum, the partials 
Ee and E BueCmGlosce LOmzcTOsmasmaren tlc wbac han Geminltalt 
peevers (XMU and YMU ); and Che ditferences a ee 
(SD). In order to determine the value of the derivative 
Meme, the sum of the squares of these differences has to be 
mommed, an operation that may very likely lead to erroneous 
fPeoults whieh, in turn, carry over anto the computation jor 
y and g. 

The countermeasure taken is to premultiply the SD 
mie they are small by a large number, (505 ££) 7° (1510 if). 

Se heSeine tne’ rooral 

Neowenrewed | liner e : @SMba ounce esme see e cuem olny senaic 
Eonsuming, the present program doés not use them. This made 
Pomme oine tedious. The “standard” routine, 1.¢€., the pro- 
gram employing the derivative games in the original form, 
was tested running a small scale example where ||[x|| was 
ee 2)ieand | |v |) was (25x 4) inalames Tt possiple to hand 
emeck the computations. 


nies asl Tata, SeOuulic suc IMO mt ne Boke Trocess 


Wececdepuceced wsing the follewine objective function: 
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F(x,y) = 2x, expl -2y,-y,] + 2x, expl -y,-2y,] 
+ xX, exp [ -Y,-¥n7Yz] 
SUbmoet ico d is yy a ee i 
1 k 
Sa Ge 2 0 


eed initial allocations x = (0,0,1), y=(0,1,0). For a 

BeecUSSION Of this example in light of the algorithm see 
[4]. The reason that this can only be solved through the 
Ippo Ooutiine: 1iésmean the fact that, against the> initial x, 
Meee Pepresemces an Cxact minimum, however, the value of 


Mie derivative game £o0r xX is positive, yielded by y~ = 


2/2, -/2/2)-. 


ecb l van eae be orn 1 OO encounter’ fas Ta gece 
up where ||x{| was (4x4), |ly{| was (5x10). While this does 





iMemeevyet represent amaeoblem in high-dimensional space, “the 
eeiemors are confident that this example provided a suffi- 
miemely severe test to demonstrate the validity of the pro- 
@ram as written. 
| 6. General Comments 

iC eTOLlOv rior ren tics sane erondcd sto Tac Iitate 
mime USe and modification of the program. 

ace -Dinigeemaietehkoeat 10n 

Wover Tatigaleul SZ ote clic opis) s slice ae uence clic ec seo eee re 

pemmces In the statwonary part (99). It can be expected that, 
Pico NOD rina bwsOlutiOn. MOStwor, tie Variables will be on 
BiemmIoundanhosw. Al Iittral point on the boundaries insures 


Bittman MuMber Oot “abSurd nalbloecataons 15 Minimal . 


oil 








Sd 











If one were to use an interior point as a 
Starting solution, it possibly would involve large numbers 
Paap SUnCmea nee dimems (6.8. , a Submarine in an alreratt 
Pam rier patrol). ‘The machine would spend an enormous 
Bmeune OlLetime reducing such allocations to zero. 

ee Wace amece seo 1ey 

Mine Tueliieweail aie SS Sec) albus sitene aS While 
jmanees are determined from the dimensions of the Spaces; 
mie user may employ his own rules. A compromise between 


t 


meascet Values too large causing “overshootins™ and values 
femsmall catising "“creepins’’ Should be considered. In gen- 
ree Che Ch ING 1S MUCK CcOStllc Pr elin cerns Ot Mlaciiinemeline 


tee policy for halving distances and ifS rationale a5 out- 


Mec i i 4 | 

c. Upper and Lower Bounds 

| Rone = Sabie lale wees ie ehacl Ib jane lace US@cl alia elie 
peeeram. Specifying individual bounds Ohya BG and ask: 


Baik does not introduce additional problems but increases the 
Peerage Space required considerably (e€.¢@., for y, two addi- 
tional arrays of the same dimension as y). 
dn Odi yiMe thenOb Ce elycm rune tuLon 
tie eal vominiineaS SiateocmS Valid sor COonmeave 
mvex tUnetions Under quite general conditions. Though the 
meesene program has been desiened to handle a particular lin- 
Prec Mponenu tal func llon, stent oudulbe tlexible, The objec; 
ELVe function mentioned in subsection 5 may serve to illus- 


ie Cums Oa. 
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a era'g) zs 2X4 expl -2y,-Y5] a 2X. CXPp [y,-2y,] 


+ Xz exp [ -Y)-yo-¥z] 


is produced by a very simple adjustment of the mission 


Gesecription: 
| h=l1 i=l k=l j=l £=2.0 
k=2 j=l Eats. 
k=3 j=l E-On0  END SOE TiS src v1 
m= 
h=1] 1=2 k=] j=l E=1.0 
k=2 j=l B=2.0 
k=3 j=l E=0.0 END OF MISSION 2 
ik 
h=1 1=3 k=] j=l E=1.0 
k=2 j=z2 E=1.0 
k=3 j=3 ES Sch Oe UNS IOI. 
m= 1 
Were ASSOC aACCG Wvaincs ar Vas eee 
Vi04 = 2.9 
Viz] = ies) 
ige associated O52 (0k) aren Cia] = C149 = Clis = 1.0 
e. Assigning Values Lae 
The values (of completing stage m of mission 1 
for submarine of type h) are relative measures. When as- 


Srening V the user should consider that a submarine may 


|e (ata 
nave spent part of its weapons (resources) during stage m-1l. 
lice May reduce 1S operational Capabilities for stage m, 
aoe tne Value for Stace m Should reflect this fact. 

ie CMO.@ Ss Jo (Oreo) 


Neh pardile ber (ote loned lh Gilap Ge x ail te 


wemonuo 2.50, Nas tO perchiesem my the user. It specifies 


OS. 





fmmemaccurdey to which Max 6(x) 91s to approximate the value 
Sethe pame F(x,y}, V. op arfects the y-minimization by 
Soirero lilgumememaccuracy, €(d), to Which the derivative game 
De pi F(x,y) = “VEO g Meloy Belen Veyor oo LUNES ies lee Wemiente Leet 


mene. Ihe Veminimization 1s the most time Consuming por- 


mon Of the process. 


e(d) = joc) 


Pewee oS tnemdianeier sot the *’-space. Considerime the 
"“worst'' case, when d = d. = 9/36-L, (L is the maximum os- 
erlilation of eee Pe wecOMesmayy amd cits Cl at 


2 


€(4o) = 3greEcT 

mot Order Of magnitude S250 

Recaliwrnde tite scCondin Pola ecs Udpiemo me dmrkom: 
fives Valididty of the algorithm are intended to guarantee 
that, at the approximate optimal solution, |¢$(x)-V[<p. 
ist runs of the program seem to indicate that the accuracy 
serecaliy obtained 1s much higher. 

PU thioucie sence yal bys valepameonc list Omes Veamno ts ac 
momived trom this observation the user must be aware of this 


Pmerteure because he. will pay heavily in terms of machine time 


frem oO 1S unreasonably small. 
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IV. SUMMARY 


The devlopment of the mathematical theory underlying 
the derivative game and the concave-convex game algorithm 
Pac Ooms Deemmeckotened out in this paper. Here, that al- 
Monteith has been employed in the formation of a potentially 
useful example. With programming techniques designed to 
peevide economical running in high dimensions, large-scale 
meoelenms Shoulldebe amenable to the application of the con- 


mire - Convex pame .alcorithm. 
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\ooeGGokollONS FORVRURIMER siUDY 


Bes MATHEMATICS 
Hime ocCGmnonmm@ilblenc. O.e., the Gquestron CL the proper choice 
Smo was addressed. Recall that 
| 
| | Max (x) - Vi< op. 
Ds 


becmewien the user has based his choice of a value for p 

amex ceNnsive Experimentation with a program, he still will 

Mee Know exactly how close Max ¢(x) is to the value of the 
x 


wae. Ihe desirable state of afiairs would be 
| Max (x) - V] = pe 


Mims would require cne tormulation of necessary conditions 


erm cae functions O Saromid -& -. 


B. PROGRAMMING 

tne fact that; for the class oe games at issue. land imue 
mmiemiaxr can be exploited to arrive at the teeta caters a 
aac P inst SQM LON taster alilally ct ommeresont jueg nalie venle 
ware the problem as MinMaxF. The course of action then is 
Mmeniersed With Considerable advantages. The maximizer sees 
Maeepresent y-allocation; the Maximization is trivial, ges- 
Pernmme as much weight aS poSsible to the x4 Wine siemmte 
largest coefficients (the els ye Whiten Tresuilees aim od 


corner solution for x. Then the B-R technique is employed 


fimectly toyr(x<,)jwhiich Well brine x off the boundaries 
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Mi hie icemaeter a pre-set numberwomelecrations, will pro- 
duce an allocation not far from the solution. At this stage 
the problem 1s reinterpreted as MaxMinF and solved in the 
manner of the present program. 

Another feasible refinement particularly useful in the 
pri ecatiron Of the algorithm to objective £Lunctions linear 
Mmimepoth xX and y, 2.e., FF = y MG Beas is the idea of 
maoubling™, outlined in [4]. The problem is treated as 
Haein and MinMax at the same time. Here the value of the 
game is approached from below and above simultaneously which 
Bovides a stopping rule when the difference Maxk(x,y)=o(x) 

x 


mee yves Aateaspre- spect tied value: 


Si) 





FLOWCHART OF THE PROGRAMMED EXAMPLE 


APPEND Xx: 
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